TITLE OF THE INVENTION 

IMAGE PBOCESSING SYSTEM VIA NETWORK 



BACKGROUND OF THE INVENTION 
5 Field of the Invention 

[0001] The present invention relates to a technique of outputting an 
image by utilizing an image file, which includes picture data and 
image processing information of the picture data. 

10 Description of the Related Art 

[0002] As a recent trend, the popular procedure generates picture 
Uji data with a shooting device, such as a digital still camera (DSC), a 

digital video camera (DVC), or a scanner and outputs an image from 
"4 an image output device, such as a CRT, an LCD, a printer, a projector, 

« 15 or a TV set. The output image may not accurately reproduce the 
A brightness or the color tone of a subject, due to the difference in color 

reproduction characteristics between the shooting device and the 
image output device. Retouching of picture data is generally carried 
out to correct such a difference in color reproduction. 
r 20 [0003] Significant skill is, however, required for such retouching, 
y Adjustment of color reproduction is thus difficult, time- consuming 

and labor-consuming. Some application programs have been 
proposed to analyze the picture data and perform automatic correction 
of the color tone and the sharpness. But such correction does not 
25 give the sufficient result since the characteristics of the shooting 
device are not reflected. In some cases, even unnecessary correction 
is carried out against the intention of the photographer in shooting. 
One applicable procedure transmits information regarding the 
characteristics of the shooting device and the intension of the 
30 photographer to the image output device and causes the image output 
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device to carry out required correction based on the transmitted 
information prior to output of a resulting image. This procedure, 
however, undesirably restricts the output resource to the output 
environment that can utilize such information. 
5 [0004] These problems are not intrinsic to the shooting devices, but 
similar problems arise in the process of generating picture data by 
computer graphics. 

SUMMARY OF THE INVENTION 

10 [0005] The object of the present invention is thus to provide a 
technique that ensures output of an image that reflects 
characteristics of a device for generating picture data and the 
intention of an operator who makes the picture data without 
significantly limiting the output environment. 

15 [0006] At least part of the above and the other related objects is 
attained by a first image processing system of the present invention 
that is connected with a printing device and a shooting device via a 
network. The printing device and the shooting device may be 
connected to the network directly or indirectly. In the latter 

20 application, for example, the printing device is locally linked with a 
computer connecting to the network. The network may be a wide 
area network like the Internet or a relatively limited network like a 
LAN (Local Area Network). 

[0007] The image processing system of the present invention carries 
25 out image processing on picture data and causes the printing device to 
perform printing via the network. The picture data is associated 
with image processing control data. In one preferable embodiment, 
the picture data and the image processing control data can be 
included in an image file. 
30 [0008] In order to actualize the above functions, the image 



2 



processing system first receives the picture data generated by the 
shooting device. A digital camera or a scanner may be used for the 
shooting device. 

[0009] After receiving the picture data, the image processing system 
5 causes the picture data to be subjected to image processing based on 
the image processing control data and conversion into a data format 
that allows supply to the printing device, thereby generating print 
data. The conversion includes a color conversion process, for 
example, from one color system of red (R), green (G), and blue (B) used 
10 for generation of the picture data to another color system of cyan (C), 
magenta (M), yellow (Y), and black (KI) used in the printing device, as 
I, well as a halftoning process. 

^ 3 [0010] The image processing system transmits the print data to the 

J printing device via the network and causes the printing device to 

15 print a resulting image. The printing device used as the output 
\X\ resource may be set in advance or may be specified by the user for 

0 each printing operation. The output resource may be specified by 

1:3 information representing the location of the printing device on the 

I:^ network, for example, address or a URI (Uniform Resource Indicator). 

20 [0011] The user transmits the picture data from the shooting device 
ily to the image processing system and enables a resulting image to be 

printed with an arbitrary printing device. The image processing 
system carries out image processing based on the image processing 
control data associated with the picture data in the process of 
25 generating the picture data by the shooting device. This ensures the 
image processing that reflects the characteristics of the shooting 
device and the intension of the photographer in shooting. A specific 
format of print data is applied for data transmission from the image 
processing system to the printing device. This enables printing 
30 based on the image processing control data, regardless of the 
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functions of the printing apparatus. The technique of the present 
invention thus ensures printing that reflects the characteristics of the 
shooting device and the intention of the photographer in shooting 
without any limitation of the printing environment. 
5 [0012] The present invention is also directed to a second image 
processing system that is connected to an image output device via a 
network. The image output device is not restricted to the printing 
device but may he a display device, such as a liquid crystal projector 
or a display. 

10 [0013] The second image processing system first receives input of 
picture data and image processing control data used for image 
: , processing of the picture data. The input of the picture data is not 

■•■3 restricted to input from a device that generates the picture data. 

The picture data may be input not via the network but via some 
15 medium. The image processing system then causes the picture data 
i.f| to be subjected to image processing based on the image processing 

=0 control data and thereby generates an output data. The image 

i;3 processing system transmits the output data to the image output 

LyJ device connecting to the network and causes the image output device 

i;i 20 to output a resulting image. 

in 

[0014] The arrangement of the second image processing system 
carries out image processing based on the image processing control 
data, regardless of the output environment. 

[0015] In the second image processing system, it is preferable that 
25 the image processing module carries out conversion into a data format 
that allows direct supply to the image output device. This ensures 
output of a processed image without requiring any further processing 
in the image output device. When the image output device is a 
printing device, the color conversion and the halftoning process 
30 discussed previously are included in this conversion process. The 
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image processing module may alternatively transmit output data in a 
data format that enables output from the image output device with a 
predetermined series of processing. 

[0016] In the second image processing system, it is also preferable 
that the image processing module selectively changes the details of 
the conversion process corresponding to the type of the image output 
device. This enables output of a processed image to diverse image 
output devices. The changeover of the conversion process 
corresponding to the image output device may be based on a user's 
input of information regarding the type of the image output device. 
The image processing system may otherwise fetch the required 
information from the specified image output device, 
[0017] Here the type represents a unit that affects the contents of 
the conversion. For example, in the case where a common format is 
applied for the format of output data in a manufacturer of image 
output devices, the type information is the manufacturer's name of 
the image output device. 

[0018] The user may individually specify output style from the 
image output device. In one preferable embodiment, however, the 
picture data is associated with output specification information for 
specifying output style, and the image processing system controls the 
output from the image output device based on this output 
specification information. The output specification information 
includes, for example, information for specifying the output resource 
and information regarding the date and time of output. When a 
printing device is used as the image output device, the output 
specification information may include the size and the type of printing 
paper used for printing and the number of copies. 
[0019] In the case where the picture data is defined in an YCbCr 
color space, the image processing carried out in the image processing 



system of the present invention includes color space conversion from 
the YCbCr color space to an RGB color space. The arrangement of 
executing the color space conversion in the image processing system 
enables the color reproduction characteristics at the time of 
generating the image file to be kept regardless of the output 
environment. 

[0020] For example, an sRGB color space is typically used as the 
RGB color space. Some picture data requires a wider range of color 
reproduction than that of the sRGB color space. The arrangement of 
performing the color conversion in the image processing system 
enables the color reproduction characteristics to be kept even in such 
cases. In order to allow the processing in a wider range of color 
reproduction, it is desirable that the color space conversion process 
includes conversion into a predetermined RGB space having a wider 
range of color reproduction than the sRGB color space. The color 
space conversion process is not restricted to the conversion into the 
color space having the wider range of color reproduction, but includes 
a diversity of conversion processes, for example, conversion into a 
color space having a relatively narrow range of color reproduction but 
a high resolution. Any of the diverse conversion processes may be 
applied selectively. 

[0021] The technique of the present invention is actualized by an 
image processing method and an image output method, in addition to 
the image processing system discussed above. The technique of the 
present invention is further attained by a computer program that 
utilizes a computer to construct the image processing system 
discussed above and by a recording medium in which such a computer 
program is recorded. Typical examples of the recording medium 
include flexible disks, CD-ROMs, magneto-optic discs, IC cards, ROM 
cartridges, punched cards, prints with barcodes or other codes printed 



thereon, internal storage devices (memories like a RAM and a ROM) 
and external storage devices of the computer, and a variety of other 
computer readable media. 

[0022] These and other objects, features, aspects, and advantages of 
5 the present invention will become more apparent from the following 
detailed description of a preferred embodiment with the 
accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

10 Fig. 1 schematically illustrates the construction of an image 

output system in one embodiment of the present invention; 

Fig. 2 illustrates the structure of a digital still camera 10 used 
as an image file generation device; and 

^3 

J Fig. 3 is a flowchart showing an image processing routine. 

'■^ DESCRIPTION OF THE PREFERRED EMBODIMENTS 

= 3 [0023] One mode of carrying out the invention is discussed below as 

^§ a preferred embodiment in the following order: 

:l A. Construction of System 

20 Al. Structure of Image File 

; A2. Structure of Image Processing System 

B. Structure of Digital Still Camera 

C. Image Processing 

D. Effects 

25 E. Modifications 
[0024] 

A. Construction of System 

Fig. 1 schematically illustrates the construction of an image 
output system in one embodiment of the present invention. The 
30 image output system includes an image file generation device, an 
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image processing system 100, and an image output device, which are 
mutually connected via a network INT. In this embodiment, a digital 
still camera 10 is used as the image file generation device. The 
image file generation device is, however, not restricted to the digital 
5 still camera 10 but may be any camera device like a digital video 
camera or a scanner. Available examples of the image output device 
include a printer FRT, a network display DSP, and a liquid crystal 
projector PRJ. The image file generation device and the image 
output device are connected to the network INT directly or via a 
10 computer. In this embodiment, the network INT may be a wide area 
network like the Internet or a restricted network like online 
communication or a LAN (Local Area Network). 

9. 

9 [0025] 

''■4 

b'*' 15 Al. Structure of Image File 

^ The image processing system 100 is a server having the 

t functions of receiving image files from the digital still camera 10 and 

transmitting processed image files to the image output device. A 
typical structure of the image file input into the image processing 

20 system 100 is illustrated in Fig. 1. The image file has a data 
structure, in which picture data with attribute information mapped 
thereto is stored. In this embodiment, the image files adopt a 
specific file structure in conformity with the Exif (Exchangeable 
Image File) format standard for digital still cameras. The Exif was 

25 established by JEIDA (Japan Electronic Industry Development 
Association). Although the Exif standard applies the JPEG format to 
record the picture data, the image files are not restricted to this 
format. 

[0026] The attribute information includes pieces of information 
30 regarding camera conditions, like the date and time of photographing. 



exposure, and the shutter speed, control data of image processing, and 
output specification information. In this embodiment, based on the 
Exif standard, the control data and the output specification 
information among the attribute information are recorded in an area 
5 MakerNote, The recording area and its format may be arbitrarily set 
according to the selected format. 

[0027] The control data controls the details of image processing on 
picture data at the time of outputting an image. In this embodiment, 
the control data mainly includes two types of data, that is, a color 

10 space parameter and a color correction parameter. 

(0028] The color apace parameter is used to transmit a color 
reproduction characteristic in the image file generation device to the 
image output device and thereby actualize precise color reproduction 
of a subject. This parameter includes a gamma correction value 

15 corresponding to the characteristic of the image file generation device 
and a specification parameter for the color space conversion method. 
The specification parameter for the color space conversion method 
specifies the method of color conversion applied for image processing 
according to the width of the color reproduction range by the image 

20 file generation device. This embodiment uses color spaces of sRGB 
and NTSC. These two color spaces have different color reproduction 
ranges. Application of the same color conversion method for image 
processing may undesirably narrow the color reproduction range of 
one color space. The specification parameter is accordingly used to 

25 specify the adequate color conversion method and ensure image 
processing without narrowing the color reproduction range in 
shooting- A diversity of formats may be used for setting the 
specification parameter. In this embodiment, the specification 
parameter determines which of the sRGB and NTSC color spaces is 

30 used for shooting. A conversion matrix used for conversion of the 



color space may alternatively be set as the specification parameter. 
[0029] The color correction parameter is data used for transmitting 
the intention of the photographer to the image output device. This 
parameter, for example, includes parameters regarding the contrast, 

5 the hrightness, the color balance, the saturation, the sharpness, and 
the registered color. The registered color represents a color used as 
the reference for tone adjustment of picture data. These parameters 
are only illustrative. The control data may include other parameters 
or include only part of the parameters described above. 

10 [0030] The output specification information functions to control the 
specification of output from the image output device. When the 
image output device is a printer, for example, the output specification 
information specifies the size and type of printing paper used for 
printing, the number of copies, and the time required for printing. 

15 The output specification information may also include address for 
specifying the output resource and information regarding the date and 
time of the output. It is, however, not necessary that the 
specification of the output resource is included in the output 
specification information. The output resource may individually be 

20 specified in the process of receiving picture data from the image file 
generation device. 

[0031] 

A2. Structure of Image Processing System 

25 The functional blocks of the image processing system 100 are 

also illustrated in Fig. 1. The respective functional blocks are 
actualized by software configuration in the image processing system 
100, An input module 101 receives input of image files from outside; 
for example, input fi:om the digital still camera 10 via the network or 

30 input via a recording medium. 
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[0032] The input image file is subjected to image processing by an 
image processing module 102. The image processing module 102 
extracts the control data for image processing from the input image 
file and processes the picture data based on the extracted control 
5 data. 

[0033] The output specification information included in the image 
file is transmitted to a type information fetching module 103. The 
type information fetching module 103 gains access to each image 
output device based on the address for specifying the output resource 
10 included in the output specification information and fetches type 
information of the image output device. The type information affects 
the conversion process discussed below, and includes information 
regarding the type of the image output device and information 
affecting the image output characteristics of the image output device. 
15 [0034] A data conversion module 104 carries out data conversion 
according to the type of the image output device. Namely the data 
conversion module 104 converts picture data into an adequate format 
that enables immediate output from the image output device. When 
the image output device is a printer, the conversion process includes, 
20 for example, color conversion from RGB into CMYK and a halftoning 
process. The data conversion module 104 refers to a type mapping 
table 104T to actualize the type-based processing. For example, 
when the image output device is a printer, the type mapping table 
104T stores information regarding the type of ink, such as dye ink and 
25 pigment ink, the number of ink colors used for printing, the printing 
resolution, and the conversion table applied for color conversion 
mapped to each type processible by the image processing system 100. 
The image processing system 100 can readily process newly available 
printers by updating the contents of this type mapping table 104T. 
30 The series of processing in the data conversion module 104 may 
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alternatively be carried out in the image output device. 
[0035] An output file generation module 105 arranges the processed 
data and constructs an output file, which is transmittable to the 
image output device. The data converted by the data conversion 
module 104 may be specified as the output file, or the converted data 
with part of the output specification information attached thereto may 
be specified as the output fi.le. The structure of the output file for the 
printer PRT specified as the image output device is also illustrated in 
Fig. 1. In this example, the output file includes print data and the 
output specification information. Here the print data represents 
data converted into a specific format that allows immediate printing 
by the printer PRT. The output specification information is attached 
to a header of the print data in the output file. The attached output 
specification information may be, for example, the type of printing 
paper used for printing and the number of copies. 
[0036] A transmission module 106 transmits the output file to the 
image output device via the network INT. The image output device 
receives the transmitted output file and prints or otherwise outputs a 
resulting image. When the output file includes the output 
specification information, the specification of output, for example, 
changeover of printing paper, is controlled by the output specification 
information. 

[0037] 

B. Structure of Digital Still Camera 

Fig. 2 illustrates the structure of the digital still camera 10 
used as the image file generation device. In the digital still camera 
10, picture data is generated by means of an optical circuit 121 
including a CCD for collecting information of light rays and an image 
acquisition circuit 122 for converting voltage signals of the CCD into 
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picture data. 

[0038] The picture data obtained here is defined in a YCbCr color 
space, which is suitable for image compression based on a JPEG 
format. A different series of processing to obtain picture data in the 
YCbCr color space from the voltage signal of the CCD is adopted 
corresponding to the type of the digital still camera 10. 
[0039] The digital still camera 10 generally obtains picture data 
defined in the RGB color space from the voltage signal of the CCD. 
An sRGB color space and an NTSC color space are selectively used 
according to the type of the camera. Both the sRGB color space and 
the NTSC color space define color in the RGB coordinate system, while 
the NTSC color space has a wider range of color reproduction than the 
sRGB color space. In the sRGB color space, color is generally defined 
in the range of 8 bits (0 to 255). A color space that extends this range 
to negative values or values of and over 256 (hereinafter referred to as 
the 'extended sRGB space') may be used instead of the general sRGB 
color space. Information on the color space used for shooting is 
included as the color space parameter described previously and 
attached to the picture data as information representing the color 
reproduction characteristics of the digital still camera 10. In this 
embodiment, the extended sRGB space and the sRGB space are in the 
identical coordinate system and are expressed by the same 
parameters. These two color spaces may alternatively be expressed 
in a discriminative manner from each other. 

[0040] The 3x3 matrix computation converts the image obtained in 
the RGB color space into data in the YCbCr color space. Namely this 
matrix is used to convert the RGB coordinate system into the YCbCr 
coordinate system. A common matrix is applicable for both the sRGB 
color space and the NTSC color space used for shooting. 
[0041] The user operates an operation unit 126 to set the shooting 
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mode, an image processing control parameter, and the layout. 
Information required for the setting is displayed on an LCD 127. The 
picture data thus obtained may be transmitted wirelessly by an aerial 
125 to the image processing system 100 via the network INT. The 
picture data may be recorded in a memory card MC inserted in a 
memory card slot 128. 

[0042] A control circuit 124 controls the operations of the digital still 
camera 10. The control circuit 124 is constructed as a microcomputer 
including a CPU and memories. The functional blocks actualized by 
the software configuration for such control in the control circuit 124 
are also illustrated in Fig. 2, 

[0043] A picture data input module 11 receives input of picture data 
via a shooting module 12 or an MC input module 13. In the case of 
the shooting module 12, picture data is generated by shooting that 
utilizes the optical circuit 121. In the case of the MC input module 
13, picture data is read from the memory card MC. 
[0044] A control data setting module 14 sets the control data 
included in the image file, in addition to the picture data. The 
control data is used to control the details of the image processing, 
which is carried out for the picture data in the process of outputting 
the image. The user sets the control data, for example, at the time of 
shooting. An operation input module 15 and a display control module 
16 give a user interface for the setting. The display control module 
16 utilizes the LCD 127 to give information to the user, whereas the 
operation input module 15 inputs the operation of the operation unit 
126. 

[0045] The user may arbitrarily set each item of the control data or 
select a desirable setting among a plurality of settings of the control 
data provided in advance. The setting of the control data may be 
selected, based on the relationship to the image output device 
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specified as the output resource, for example, the type of ink, dye ink 
or pigment ink, used in the printer specified as the output resource 
and the number of ink colors. The selection may also he based on the 
type of the image output device, for example, a color printer, a display, 
5 or a projector. The multiple settings of the control data may be 
mapped to one picture data. 

[0046] An image file generation module 17 specifies the mapping of 
the data from the control data setting module 14 to the data from the 
picture data input module 11 and generates an image file. The 
10 structure of the image file is discussed previously with reference to 
Fig. 1. 

i.^ [0047] The image file thus generated is output to outside via a 

^3 transmission module 18 or an MC output module 19. The 

•i'l transmission module 18 controls wireless communication via the 

^f' 15 aerial 125. The transmission module 18 functions to implement 
'"l transmission of the image file to the image processing system 100 via 

the network INT. The MC output module 19 controls writing into the 
1 memory card MC. The image file written in the memory card MD can 

" be transmitted to the image processing system 100 or any other 

20 suitable external device. 

[0048] 

D. Image Processing 

Fig. 3 is a flowchart showing an image processing routine, 

25 which is executed by the image processing system 100. The image 
processing system 100 first receives input of an image file and 
specification of an output resource at step SIO. The image file may 
be transmitted from the digital still camera 10 via the network or read 
from the memory card MC. The output resource is specified by 

30 information like a URI (Uniform Resource Indicator) or an IP address 
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representing the location of the image output device on the network 
INT. In this embodiment, such information is included in the output 
specification information in the image file. Alternatively such 
information may be specified by an operation of the digital still 
camera 10 in the course of receiving the image file. The image 
processing system 100 analyzes the image file and extracts the picture 
data and the control data from the input image file. 
[0049] The image processing system 100 fetches the type 
information based on the specification of the output resource at step 
S12. In the procedure of this embodiment, the image processing 
system 100 gains access to the specified output resource via the 
network INT to fetch the type information. The type information 
includes information regarding the type of the image output device, 
for example, a printer, a display, or a scanner, and information 
regarding the name of the manufacturer of the image output device. 
When a printer is used as the image output device, the type 
information includes information regarding the type of ink, that is, 
pigment ink or dye ink, used for printing, the number of ink colors 
used for printing, and the printing resolution. The type information 
is utilized in a color conversion process and a halftoning process 
discussed later. 

[0050] The image processing system 100 subsequently carries out 
image processing based on the information thus obtained. As 
mentioned previously, in this embodiment, the picture data is defined 
in the YCbCr color space. The image processing system 100 thus 
converts the picture data in the YCbCr color space into data in the 
RGB color space used for shooting at step S14. An inversion matrix, 
which is inverse to a matrix used for conversion from the RGB space 
to the YCbCr space in the digital still camera 10, is applied for this 
conversion. This process converts the picture data into the data in 



16 



the color space used for shooting, that is, one of the NTSC color space, 
the sRGB color space, and the extended sRGB color space. In the 
case of conversion into the extended sRGB color space, the color 
reproduction range includes negative values and values of and over 
5 256. 

[0051] The image processing system then performs gamma 
correction of the picture data at step S16. The gamma value used for 
the gamma correction is included in the control data as information 
representing the characteristic of the digital still camera 10. 
10 [0052] After completion of the gamma correction, the image 
processing system 100 converts the color space of the picture data into 
U the wRGB color space, which is defined to have the wider color 

;;3 reproduction range than the sRGB color space. When the picture 

%j data defined in either the NTSC color space or the extended sRGB 

5 15 color space is processed in the sRGB color space having the narrower 
in color reproduction range, the colors of the subject may not be 

''^ reproduced accurately. From this point of view, the picture data 

53 generated in the sRGB color space may skip a series of processing 

discussed below. In this embodiment, however, the color space 
20 information included in the control data does not discriminate the 

CI 

fy sRGB color space from the extended sRGB color space. The 

procedure of this embodiment accordingly carries out conversion of 
the picture data generated in the sRGB color space into data in the 
wRGB color space. Even under such conditions, since the picture 
25 data in the extended sRGB color space includes negative values or 
values of or over 256, the extended sRGB color space may be 
distinguished from the sRGB color space based on these tone values. 
[0053] Matrix computation is applied for the conversion into the 
wRGB color space. As described previously, the image processing 
30 system 100 deals with picture data defined in either the sRGB color 
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space or the extended sRGB color space and the picture data defined 
in the NTSC color space. Matrixes for directly converting the picture 
data in the respective color spaces into data in the wRGB color space 
may be specified. The procedure of this embodiment, however, 
carries out conversion via a standard XYZ color space. 
[0054] The image processing system 100 first carries out conversion 
from the RGB color space to an XYZ color space at step S18. The 
conversion process depends upon the color space in which the picture 
data is defined. The procedure of this embodiment accordingly 
provides two conversion matrixes in advance, that is, a conversion 
matrix TMl for the sRGB color space or the extended sRGB color 
space and another conversion matrix TM2 for the NTSC color space, 
and selectively uses one of the two conversion matrixes TMl and TM2 
to implement conversion according to the color space used for shooting. 
The conversion changes the individual color spaces, in which the 
picture data is generated, into the standard XYZ color space. 
[0055] The image processing system 100 then carries out conversion 
from the XYZ color space to the wRGB color space at step S20. 
Matrix computation is also applied for this conversion. An identical 
matrix is used for this conversion, irrespective of the color space in 
shooting. The matrix used for the computation may be set arbitrarily 
according to the definition of the wRGB color space. 
[0056] As described above, the picture data obtained in the sRGB 
color space is not required to be converted into data in any wider color 
space, so that the processing of steps S18 and S20 may be skipped. 
In the case where the NTSC color space is utilized as the wider color 
space than the sRGB color space, the picture data obtained in the 
NTSC color space may skip the processing of steps S18 and S20. The 
processing of steps 818 and S20 can be omitted according to the 
relationship between the color space used for shooting and the color 
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space finally used for the output. 

[0057] After completion of the color space conversion process, the 
image processing system 100 carries out inverse gamma correction at 
step S22. The gamma value used here is set, based on the color 
reproduction characteristics of the image output device. In this 
embodiment, the image processing system 100 receives the gamma 
value from the image output device in the process of fetching the type 
information at step S12. In the case where the type of the image 
output device is known at the time of shooting, the type information 
may be included in the control data attached to the picture data. 
[0058] The image processing system 100 subsequently carries out 
automatic adjustment of the picture quality to reflect the intention of 
the photographer in shooting at step S24. In this embodiment, the 
adjustment parameter with regard to, for example, the contrast is 
included as the color correction parameter in the control data. The 
image processing system 100 implements automatic adjustment of the 
picture quality, based on this parameter. The method of adjusting 
the picture quality based on such a parameter is known in the art and 
is thus not specifically described here. 

[0059] This series of processing completes the correction of picture 
data that reflects the color reproduction characteristics of the digital 
still camera 10 and the intention of the photographer in shooting. 
The image processing system 100 may output the resulting picture 
data to the image output device without any further processing. The 
procedure of the embodiment, however, converts the processed picture 
data into a specific format that allows direct output from the image 
output device. 

[0060] The details of such conversion are discussed below in an 
example of the printer as the image output device. The image 
processing system 100 causes the RGB picture data to be subjected to 
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a color conversion process corresponding to tlie type of the printer at 
step S26. This process converts the RGB color system into the CMYK 
color system used in the printer. The conversion is performed by 
referring to a conversion lookup table (LUT) that maps the colors of 
one color system to the colors of the other color system. The 
procedure of this embodiment typically uses a conversion table LUTw 
for conversion of the wRGB color space into the CMYK color space. 
The image processing system 100 also stores another conversion table 
LUTs for the sRGB color space, in order to allow processing of picture 
data defined in the sRGB color space. The image processing system 
100 selectively uses the adequate conversion table corresponding to 
the color space in which the picture data is defined. The conversion 
table LUTs may be used, for example, when the color space conversion 
process of steps S18 and S20 is skipped for the picture data obtained 
in the sRGB color space and when the input image file is output 
without any processing for adjusting the picture quality. 
[0061] The LUT depends upon not only the color space of picture 
data but the type of the printer, since the type of ink and the number 
of ink colors may be varied in each type of the printer. The image 
processing system 100 thus selectively uses the adequate LUT 
corresponding to the type of the printer and carries out the color 
conversion process at step S26. 

[0062] The image processing system 100 then carries out halftoning 
of the picture data converted to the tone values of CMYK at step S28. 
The halftoning process enables the tone values of picture data to be 
expressed by the density of dots formed by the printer. Any known 
method like the error diffusion method or the systematic dither 
method may be applied for the halftoning process. 
[0063] In addition to the above series of processing, the image 
processing system 100 may carry out a resolution conversion process. 
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which converts the resolution of picture data into a printing 
resolution adopted in the printer, and an interlace data generation 
process, which sets a data arrangement and feeding quantities of 
sub-scan to enable interlace recording in the printer. 
[0064] The picture data is converted into a specific format of print 
data that enables immediate output from the printer through the 
conversion at steps S26 and S28. The image processing system 100 
then transmits the resulting converted data as the output file to the 
specified image output device via the network INT at step S30. The 
image output device implements printing based on the transmitted 
data. 

[0065] At least part of the output specification information, in 
addition to the print data, may be included in the output file 
according to the requirements. For example, the output specification 
information regarding the number of copies and the type of printing 
paper used for printing may be included in the output file to ensure 
output according to the specification. Arbitrary setting may be 
applied to make the output specification information included in the 
output file; for example, the output specification information may be 
added to the header of the print data. 

[0066] 
D. Effects 

In the image output system of the embodiment discussed above, 
the control data includes the color reproduction characteristics of the 
image file generation device and the intension of shooting to ensure 
output of an image reflecting such specification. The image 
processing system 100 on the network enables image processing based 
on the control data without depending upon the output environment, 
for example, the processing capacity of the image output device. 
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[0067] The image output system of the embodiment utilizes the 
image output device connecting with the network. The user can thus 
output images from an arbitrary image output device. This 
arrangement enables images to be output to any third person who is 
at a remote place. The output does not depend upon the output 
environment of the receiver who receives images, but reflects the color 
reproduction characteristics in shooting. 

[0068] In the image output system of the embodiment, data 
transmission from the image processing system 100 to the image 
output device is implemented in the specific data format that allows 
immediate output from the image output device. This 
advantageously relieves the load of processing in the image output 
device. 

[0069] 

E. Modifications 

The above embodiment regards output of images to the 
printing apparatus. A display or a projector connecting with the 
network may be applied for output of images. 

[0070] The diverse series of image processing discussed in the above 
embodiment may not be all executed in the image processing system 
100, but part of the image processing may be performed in the image 
file generation device or in the image output device. 
[0071] In this embodiment, the image processing system 100 is 
constructed by a single server. The image processing system may 
alternatively include multiple servers for distributed processing. 
[0072] Although the above embodiment regards application to still 
pictures, the principle of the present invention is also applicable to 
moving picture data like MPEG. One exemplified procedure adds 
output control data including image processing control data to a 
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moving picture file and controls output of all or part of the frames of 
the moving picture. 

[0073] The above embodiment and its modifications are to be 
considered in all aspects as illustrative and not restrictive. There 
may be many modifications, changes, and alterations without 
departing from the scope or spirit of the main characteristics of the 
present invention. For example, the diverse control processes 
discussed above may be attained by the hardware structure, instead of 
the software configuration. 

[0074] The scope and spirit of the present invention are indicated by 
the appended claims, rather than by the foregoing description. 



